The MUeSLI Multimodal 3D Retail System
نویسندگان
چکیده
This paper describes a multimodal spoken language system, which allows users to furnish a virtual 3D living room. Speech and touch modalities are tightly integrated in a single user i nput turn. An advanced dialogue manager allows users to have a natural flexible style of interaction with the "virtual assi stant" (a talking head). The system is mixed initiative, with a system intelligence which allows the assistant to make expert suggestions on room design. This paper concentrates on the architecture and components which were needed to achieve these results.
منابع مشابه
Developing robust, user-centred multimodal spoken language systems: the MUeSLI project
The Multimodal Spoken Language Interfaces (MUeSLI) project at BTexaCT aims to conduct practical research into developing advanced multimodal spoken dialogue systems with a distinctive user focus. In this paper we intend to convey the main aims and motivation behind the project and to describe the particular research application we have built. We recently conducted a user trial where a fully aut...
متن کاملA realistic wizard of oz simulation of a multimodal spoken language system
This paper describes a Wizard of Oz (WOZ) system that allows the realistic simulation of a multimodal spoken language system. A Wizard protocol has been drawn up which means that the WOZ system will simulate the limitations of an automatic system rather than allow the user to engage in the full range of human-human dialogue. In support of this protocol is a sophisticated Wizard response panel a...
متن کاملA Decision Support System for Urban Journey Planning in Multimodal Public Transit Network
The goal of this paper is to develop a Decision Support System (DSS) as a journey planner in complex and large multimodal urban network called Rahyar. Rahyar attempts to identify the most desirable itinerary among all feasible alternatives. The desirability of an itinerary is measured by a disutility function, which is defined as a weighted sum of some criteria. The weight...
متن کاملNonlinear energy harvesting through a multimodal electro-mechanical system
A semi-analytical method is used to illustrate the behavior of a multimodal nonlinear electromechanical system which is under base-excitation. System is considered as piezo-ceramic patches attached to a cantilever beam coupled to a resistive load. The cantilever beam is modeled as a nonlinear Timoshenko beam using Assumed Mode method and equations of motion are derived through Lagrange's equati...
متن کاملFuzzy particle swarm optimization with nearest-better neighborhood for multimodal optimization
In the last decades, many efforts have been made to solve multimodal optimization problems using Particle Swarm Optimization (PSO). To produce good results, these PSO algorithms need to specify some niching parameters to define the local neighborhood. In this paper, our motivation is to propose the novel neighborhood structures that remove undesirable niching parameters without sacrificing perf...
متن کامل